Feedback and activity in dialogue: signals or symptoms?
نویسنده
چکیده
This paper presents new approaches to modelling both linguistic and non-linguistic feedback during instruction giving in a virtual domain. Our approach enables finegrained investigation of how language and actions are conditioned by task-level and domain-level features of dialogue. In a preliminary study, we examine the interaction between pauses in linguistic and non-linguistic activity. As far as we know, ours is the first analysis of pauses across modalities. In the longer term, we aim to use these techniques as a window on the underlying processes conditioning feedback, and for such applications as the generation of situated forms of listening, such as instruction following.
منابع مشابه
A Model for Context-sensitive Interpretation of Communicative Feedback
A prevalent and important coordination mechanism in dialogue is communicative 'listener feedback' in form of short verbal-vocal signals (e.g., 'uh-huh', 'yeah', 'huh'), head gestures (e.g., nodding, wiggling) or facial expressions. Listeners' feedback signals are indications of their cogni-tive state and communicate whether listeners and speakers are in contact , whether listeners perceive, und...
متن کاملMental Fatigue Assessment using recording Brain Signals: Electroencephalography
Background and Objectives: Mental fatigue is a condition triggered by prolonged cognitive activity. Mental fatigue causes brain over-activity. This is a condition where the brain cells become exhausted, hampering person productivity, and overall cognitive function. The aim of this study was to assess students’ mental fatigue using brain indices. Methods: The present descriptive - analytic stud...
متن کاملUnderstanding How Well You Understood - Context- Sensitive Interpretation of Multimodal User Feedback
Human interlocutors continuously show behaviour indicative of their perception, understanding, acceptance and agreement of and with the other’s utterances [1,4]. Such evidence can be provided in the form of verbal-vocal feedback signals, head gestures, facial expressions or gaze and often interacts with the current dialogue context. As feedback signals are able to express subtle differences in ...
متن کاملNavigating joint projects with dialogue
Dialogue has its origins in joint activities, which it serves to coordinate. Joint activities, in turn, usually emerge in hierarchically nested projects and subprojects. We propose that participants use dialogue to coordinate two kinds of transitions in these joint projects: vertical transitions, or entering and exiting joint projects; and horizontal transitions, or continuing within joint proj...
متن کاملRobot control system using SMR signals detection
One of the important issues in designing a brain-computer interface system is to select the type of mental activity to be imagined. In some of these systems, mental activity varies with user intent and action that must be controlled by the brain-computer system, and in a number of other signals, the received signals contain the same activity-related mental activity that should be performed by t...
متن کامل